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ABSTRACT 


This  paper  deals  with  a  method  of  optimizing  the  free  coef- 
ficients in  the  characteristic  equation  of  a  linear  feedback  con- 
trol system.   The  optimization  is  carried  out  by  minimizing  an 
index  of  performance  associated  with  the  system's  response  to  a 
given  test  disturbance. 

The  index  of  performance  is  the  integral  of  a  quadratic 
function  of  the  system  state  variables.   The  structure  of  the  in- 
dex rests  upon  a  logical  interpretation  of  the  regulator  nature 

rh 

of  the  control  problem.   The  index  for  an  n —  order  system  con- 
tains n  weighting  factors  whose  values  are  determined  from  an 
th 


order  model  system.   This  determination  is  such  that  the  op- 
timization of  a  completely  free  system  will  yield  the  model  sys- 
tem.  A  system  with  fewer  than  n  degrees  of  freedom  in  the  state 
variable  feedbacks  may  be  optimized  with  respect  to  the  free 
feedback  coefficients,  yielding  a  system  whose  dynamic  response 
to  a  given  disturbance  is,  for  this  optimization  scheme,  a  best 
approximation  to  that  of  the  model. 

Examples  are  presented  for  illustration  of  the  salient  fea- 
tures of  the  method.   It  is  also  shown  by  example  that  systems 
with  closed-loop  zeros  may  be  optimized  by  this  method. 
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CHAPTER  I 
INTRODUCTION 

The  task  of  designing  a  feedback  control  system  normally  begins 
with  a  mathematical  modeling  of  the  open-loop  system,  process,  or  plant 
that  is  to  be  controlled.   This  modeling  permits  an  analytical  treat- 
ment whereby  the  response  of  the  closed- loop  system  is  determined  for  a 
given  test  input.   This  response  is  very  likely,  at  first,  to  be  unsatis- 
factory with  respect  to  a  given  set  of  specifications;  compensation  of 
the  control  system  is  then  indicated. 

Compensation  is  to  some  extent  a  matter  of  judgement;  i.e.,  the 
choice  of  a  compensation  scheme  depends  upon  such  factors  as  cost, 
physical  limitations  of  equipment,  availability  of  certain  items  of 
information  as  readable  signals,  etc.,  all  tempered  by  the  experience 
of  the  designer. 

It  is  now  assumed  that  a  compensation  scheme  has  been  chosen  by 
the  designer,  and  that  the  resulting  compensated  closed-loop  transfer 
function  has  no  zeros*  and  may  be  written 

CLTF  =  r-^ - (1) 

n      n-1        n-2  v  ' 

s  +  a  s    +  a   s    + +  a 

n        n-i  1 

where  the  a's  and  k  are  functions  of  the  various  plant  and  compensator 

parameters.   The  signal-flow  graph  of  Figure  1  represents  the  transfer 

function  of  equation  (1). 

*  This  restriction  will  later  be  relaxed. 


Fig.  1   Signal-flow  graph  for  the 
transfer  function  of  equation  (1) 

It  is  at  this  point  that  the  designer  must  translate  the  given 

time  and/or  frequency  domain  specifications  into  desired  root  values 

for  the  characteristic  polynomial,  or  equivalent ly,  the  poles  of  the 

closed-loop  transfer  function.   If  all  n  coefficients  in  the  character* 

istic  equation  were  freely  variable,  the  n  poles  could  conceivably  be 

placed  at  any  pre-selected  combination  of  positions.   This,  of  course, 

is  rarely  the  case,  since  some  of  the  a  's  contain  or  represent  fixed 

n 

plant  parameters.  As  a  rule,  one  free  parameter  is  required  for  each 
distinct  pole  that  is  to  be  placed  in  a  pre-selected  position,  or 
conversely,  as  many  poles  may  be  arbitrarily  placed  as  there  are  free 
coefficients  in  the  characteristic  equation.    Magnitude  constraints 
and  other  physical  limitations  may  further  restrict  the  placement  of 
poles  to  certain  regions  in  the  s-plane. 


**  A  complex  conjugate  pair  may  have  one  or  the  other  of  its  polar  co- 
ordinates (zeta,  omega)  fixed  by  one  free  coefficient. 


On  the  ability  to  pre-select  some  of  the  poles  of  the  system  rests 
the  basis  of  the  dominant  mode  method  of  design.   The  designer  uses  as 
many  free  coefficients  as  are  available  to  place  a  corresponding  number 
of  the  n  poles  in  pre-selected  positions,  with  the  hope  that  these  poles 
so  placed  will  dominate  the  response  of  the  system  to  any  input.  Whether 
or  not  they  are  indeed  dominant  depends  upon  where  the  remaining  poles 
are  found  to  lie,  how  they  make  their  presence  felt  in  the  time  or  fre- 
quency domain,  and  upon  the  degree  of  extra-pole  interference  judged 
to  be  tolerable  by  the  designer.   It  is  to  be  noted  that  the  presence 
of  closed- loop  zeros  further  complicates  the  dominance  picture,  very 
possibly  destroying  the  hoped-for  dominance  of  a  carefully  placed  set 
of  poles. 

The  dominant  mode  method  places  emphasis  on  a  limited  number  of 
the  system's  closed-loop  poles  in  the  hope  that  they  will  dominate  the 
system  dynamics.   It  is  shown  herein  that  more  attention  might  pro- 
fitably be  directed  toward  placing  all  the  system" s  poles  in  such  a 
way  that  no  group  of  poles  is  necessarily  dominant,  while  all  the 
poles  collectively  give  system  dynamics  closely  emulating  those  of  the 
specifications.   Such  a  procedure  would  start  by  establishing  an  ideal 
or  model  system  of  the  form  of  Figure  1.   This  model  system  would  be 

of  the  same  order  as  the  actual  system,  and  the  a  coefficients  would 

n 

be  selected  on  the  basis  of  the  given  specifications  and  their  trans- 
lation to  suitable  pole  values.   A  similar  diagram,  drawn  for  the 
actual  system,  would  show  some  of  the  feedback  coefficients  as  functions 
of  fixed  system  parameters,  the  remainder  as  variable  functions  of  the 
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free  plant  or  compensator  parameters.  The  presence  of  fixed  parameters 
in  the  actual  system  effectively  constrains  the  eventual  design  to  cer- 
tain definite  regions  in  the  s-plane.   The  design  proceeds  by  selecting 
values  of  the  variable  coefficients  in  the  constrained,  actual  system 
in  such  a  way  that  it  closely  approximates  the  ideal  model  in  its  dy- 
namic behavior  in  response  to  a  given  disturbance .   This  selection  is 
to  be  made  through  the  mechanism  of  a  cost  function,  or  index  of  per- 
formance, the  fundamental  structure  of  which  is  based  upon  intuitive 
judgement  and  some  mathematical  requirements.   The  index  is  so  fash- 
ioned that  it  contains  n  undetermined  weighting  factors,  where  n  is 
the  order  of  the  system  being  considered.  To  derive  an  algorithm  for 
the  determination  of  these  factors  for  all  systems  of  order  n,  an 
optimization,  or  minimization  of  the  index  is  first  carried  out  in 
such  a  way  that  the  n  weighting  factors  are  forced  to  be  functions 

of  the  n  model  feedback  coefficients,  the  a  '  s. 

n 

The  actual  n   order  system  is  once  again  considered.   The  index 
becomes,  at  this  point,  a  function  of  some  fixed  system  parameters, 
some  variable  parameters  whose  values  are  to  be  optimized,  the  n 
weighting  factors  whose  values  are  determined  by  the  designer's  choice 
of  a  model  system,  and  the  n  state  variables  as  they  respond  to  a 
given  disturbance.   If  n  parameters  in  the  actual  system  were  free, 
minimization  of  the  index  would  drive  those  parameters  to  the  model 
values,  giving  the  desirable  result  of  identical  model  and  actual  sys- 
tems, if  mi  (m  <  n)  of  the  actual  coefficients  were  fixed,  minimization 
of  the  index  with  respect  to  the  remaining  n-ra  free  coefficients  would 
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yield  a  system  optimum  with  respect  to  an  index  of  performance  not  en- 
tirely arbitrary,  but  based  in  good  measure  upon  the  pole  locations  of 
an  ideal  model  system.  In  this  sense,  then,  the  system  so  designed  is 
a  "best"  approximation  to  the  model. 

In  the  literature  dealing  with  the  optimum  design  of  linear  feed- 
back control  systems,  much  reference  is  made  to  arbitarily  selected  in- 
dices of  performance,  many  of  which  will  either  not  allow  the  selection 
of  finite  values  for  certain  parameters,  or  will  not  allow  optimization 
with  respect  to  more  than  one  system  parameter;  e.g.,  integral  square 
error.   Furthermore,  optimization  with  respect  to  such  indices  often 
seems  too  much  like  an  end  in  itself,  rather  than  a  means  to  the  end 
of  procuring  system  dynamics  that  will  meet  given  time  and  frequency 
domain  specifications. 

Some  attempts  have  been  made  to  overcome  the  deficiencies  mentioned 
above.   Rekasius  has  proposed  an  index  based  on  a  model  differential 
equation  of  order  less  than  that  of  the  actual  system  being  designed. 
This  approach  somewhat  restricts  the  flexibility  available  to  the  de- 
signer in  constructing  a  satisfactory  model.   The  present  method  also 
allows  optimization  with  respect  to  an  index  of  performance;  a  single 
measure,  to  be  sure,  but  one  which  incorporates  such  time  and  frequency 
domain  specifications  as  bandwidth,  rise  time,  and  peak  overshoot 
through  the  correlation  of  model  dynamic  response  to  model  pole  location 
and  the  dependence  of  the  index's  weighting  factors  on  these  pole  lo- 
cations.  Furthermore,  the  model  and  actual  systems  are  necessarily  of 
the  same  order. 

5 


The  chapters  that  follow  will  show  the  main  steps  in  the  selection 
of  the  model-based  index  of  performance  and  the  derivation  of  the  algo- 
rithm by  which  the  n  weighting  factors  are  determined.   The  algebraic 
details  of  the  derivation  are  given  in  the  appendix.   The  index  is 
generalized  for  the  n   order  system  with  no  zeros  in  the  closed-loop 
transfer  function,   included  are  several  examples  of  the  use  of  the 
index  in  system  design,  for  demonstration  of  the  salient  features  of 
the  method.   It  is  also  shown  by  example  that  the  index  may  be  used 
in  the  design  of  systems  including  zeros. 


CHAPTER  II 

DERIVATION  OF  THE  INDEX  OF  PERFORMANCE 

1 
The  index  of  performance,  or  cost  function  ,  that  is  to  link  the 

actual  and  model  system  behavior  will  by  choice  be  a  quadratic  integral 

functional  of  the  form 


00 

J  =     (x^x  +  uTQ2u)  dt 


(2) 


where  x  and  u  are  as  shown  in  Figure  1.   A  quadratic  form  is  chosen 
simply  because  it  admits  of  some  mathematical  treatment  that  would  be 
very  difficult  if  not  impossible  had  another  form  been  chosen.   The 
differential  equation  of  the  system  of  Figure  1  may  be  written  in 
vector  matrix  form  as 


x  =  Gx  +  u 


where  G  is  given  by 


(3) 


G  = 


0   1 


O 


o  1 

\  \ 
\  \ 

\  Ni 


O 


\ 


(4) 


from1 


x  =  x      ;   m  <  n 

m     m+1 


(5a) 


and  *n  ■  u  (5b) 

For  convenience,  system  response  will  be  initiated  by  initial  conditions 


rather  than  by  external  inputs,  resulting  in  a  u  matrix  of  the  form 


u  as  Ax  = 


O 


"al  "a2  "an 


(6) 


Equation  (3)  may  now  be  written 


x  ss  Gx  +  Ax 


^Fx 


(7) 


The  transpose  of  equation  (6)  may  be  substituted  into  equation 
(2)  to  give 

J  =  J  [*T(Q!  +  ATQ2A)  x]  dt 


A  f   t 


J  xTQx 


dt 


(8) 


Except  for  the  form  of  the  Q.  and  Q  matrices,  equations  (2)  through 

(8)  completely  describe  the  model  system  and  its  associated  cost  function, 

The  evaluation  of  J  for  an  arbitrary  set  of  initial  conditions  is 
to  be  carried  out  using  vector  matrix  methods .   Consider  a  Liapunov  func- 
tion of  the  system; 


A  T 
V(x)  ss  x  Px 


(9) 


Where  P  is  a  positive-definite,  symmetric  matrix.   V(x)  possesses  the 


following  properties  ,  provided  the  system  is  stable: 


a)  V(x)  >  0,  x  ±   0 

=  0,  x  =  0 

b)  V(x)  =  ^Zgl  <  0,  x  >  0  (10) 

=  0,  X  ■  0 

c)  V(x)  -»  oo  as  |x|  -•  » 

d)  V(x)  -  0  as  t  -  oo 

Differentiation  of  equation  (9)  with  respect  to  time  yields 

V(x)  =  xTPx  +  xTPx  (11) 

Using  the  transpose  of  equation  (7)  in  equation  (11)  gives 

V(x)  ■  xT(FTP  +  PF)  x  (12) 

To  this  point,  the  P  matrix  and  the  V(x)  function  associated  with  it 
are  not  defined.  This  definition  is  established  by 

V(x)  =  xT(FTp  +  PF)  x 

-  2iT(-Q)  i  (13> 

Equation  (13)  is  now  integrated  as  follows: 

00  CO 

*  V(x)dt  =  -  I  xTQx  dt  (14) 

Jo  Jo 

The  right-hand  side  of  the  preceeding  equation  is  immediately  recog- 
nized as  the  negative  of  the  cost  function,  equation  (8).   Evaluating 
the  left-hand  side  of  (14)  and  substituting  limits  yields 

J  =  -  v[x(»)]  +  v[x(0)]  (15) 

For  a  stable  system,  x(oo)  -»  0,  and  from  the  properties  given  in  equations 


(10),  V  [0]  =  0.     Therefore 

j  =  V  [x(0)]  =  x(°)TP  2£<°)  <16> 

Equation  (16)  reveals  that  the  cost  incurred  by  the  system  in  response 
to  a  set  of  initial  conditions  is  a  function  only  of  those  initial 
conditions  and  of  the  P  matrix.   The  P  matrix  in  turn  is  a  function  of 
the  system's  F  matrix  and  of  the  Q  matrix,  as  given  in  equation  (13). 
There  remains,  then,  the  task  of  fashioning  the  Q  matrix  to  fulfill 
the  mission  set  forth  in  the  introduction  and  above.   The  following 
requirements,  some  mathematical  and  others  intuitively  logical,  are 
to  be  considered  in  the  selection  of  the  Q.  and  Q  matrices: 

a)  Q  must  be  a  square,  nxn,  symmetric  matrix. 

b)  Q  is  to  be  such  that  all  states  are  included  in  J.  This  is  a 
logical  consequence  of  the  regulator  nature  of  the  problem. 
Since  all  states  are  to  be  driven  to  zero,  they  should  all 
contribute  in  some  measure  to  the  cost,  the  subsequent  mini- 
mization of  which  yields  an  optimum  transition  to  the  origin 
of  the  state  space. 

c)  Q.  and  Q  are  to  be  such  that  together  they  introduce  n 
weighting  factors,  whose  values  will  ultimately  depend  upon 
the  n  feedback  coefficients  of  the  model  system,  or,  equi- 
valent ly,  upon  the  model  poles. 

d)  Q  is  to  be  such  that  J  includes  the  "control  effort"  vari- 
able u.   This  will  act  as  a  constraint  to  prevent  results 
calling  for  infinite  system  parameters.   It  also  insures  that 
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the  optimum  control  is  a  linear  function  of  the  system 


4 
states  . 


In  the  light  of  the  requirements  stated  above,  the  following  con- 
figurations are  suggested  for  the  Q  and  Q  matrices; 

1 


«l" 


and 


"a- 


,  o 

o  x  «„_ 

O  X 


(17) 


X;   X  is  a  scalar 


where  a,  through  a     and  X  constitute  the  n  weighting  factors.  These 
l  n 

combine  by  equation  (8)  to  give 


Q  = 


1  +  X«L  *aia2 


>Vl  a2  +  Xa2 


\ 


>Vn 


XVn 


\ 


V. 


\ 


X 


*Vl 


n  n 


(18) 


The  P  matrix  may  now  be  evaluated  literally,  from  equation  (13) .   This 
is  done  for  the  second  and  third- order  systems  in  the  appendix,  with 
results  included  for  the  fourth  and  fifth-order  models  as  well.  The 
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second-order  results  are  presented  here  for  illustration. 

a2  ai  r        qu\ 

Pll=     "q12  +  2^  qll  +     2a^q22  +  ^V 

hi'     P21  =     £7  <19> 

i  r  qi^ 


P22=      2a^^q22+       ^  . 

With  the  appropriate  q..'s  substituted  in  equations  (19), 

a2     altt2     1     Xai 
Pll  "  2ax  *  2a2  +  2a2  +  2a2 

1      Xal 
P12  "  P21  -   2^  +  *T  (20) 

^2   ^2    J_    ^1 
P22  "  2a2  +  2  +  2aia2  +  2a2 

Equation  (16)  is  now  written  in  scalar  form  to  show  the  relationship 
between  J,  the  initial  conditions,  and  the  elements  of  the  P  matrix. 

J  =  x*<0)  pn  +  2p12  x1(0)  x2(0)  +  x2(0)  p22    (21) 

What  follows  is  the  key  point  of  the  entire  derivation.   The  values 
of  (x7   and  \   must  be  found  so  that,  for  the  unconstrained  system,  the 
minimization  of  J  with  respect  to  a^  and  a£  gives  resulting  optimum 
values  of  a^  and  a2  that  are,  independently  of  the  initial  conditions, 
equal  to  the  model  values;   i.e.,  it  is  necessary  to  find  the  elements 
&-   and  \  as  functions  of  the  desired  coefficients  a  and  a  so  that 
the  adjustment  of  the  actual  coefficients  to  the  desired  values  will 
simultaneously  minimize,  the  J  of  equation  (21)  for  any  set  of  initial 
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conditions. 

The  measures  indicated  above  are  carried  out  by  first  taking  the 
gradient  of  J  with  respect  to  a.,  and  a  . 

M     o    ^pll  9p12    2    9P22 

¥*x  -   Xl(0)  olf  +  2X1(0)  X2<°>  o^f  ♦  X2<°>  5^-  =  ° 

(22) 

*T      2    ^P11  *P12     2    *P22 

U2  "  X>  ^  +  2X1(0)  X2<°)  Slf  +  *2<°>  Sjf  "  ° 

The  initial  conditions  will  be  assumed  to  be  generally  non-zero  and 
completely  independent.  The  only  possible  solution  to  equations  (22) 
must  then  be  of  the  form 

*Pii 

^±1=  0;   i,  j  =  1.....B  (23) 

Substitution  of  equations  (20)  into  equations  (23)  yields 

X  =  -j-  (24) 

al 

and 

a2  "  2al 
a2  =  -*-j <25> 

al 

Similar  developments  have  been  carried  out  for  the  third  and 
fourth-order  systems,  some  details  of  which  are  included  in  the  ap- 
pendix. At  this  point,  a  recursion  formula  for  the  structure  of 
the  a's  in  an  n   order  model  was  postulated  on  the  basis  of  second, 
third,  and  fourth-order  model  calculations.   From  this  recursion 
formula,  equation  (26),  a  prediction  was  made  for  the  fifth-order 

13 


case,  and  was  proved  correct  by  extremely  lengthy  but  straightforward 
algebra.  This  successful  prediction  of  the  fifth-order  a's  has  been 
accepted  as  sufficient  proof  of  the  validity  of  the  recursion  formula, 


a 


and 


j. 

i,n  "    2 

al 


A-  -9 


n-1 


■J  ♦  2  I  CD- 


a .  ,  •  a .  . 
l-k     l+k 


k=l 


(26) 


where  n  is  the  order  of  the  model,  and  1  £  i  £  n.   By  definition, 


a   =  0 
o 


a   .  =  1 
n+1 


(27) 


a(rv,l+jt)  "  °  >    *  >   ° 
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CHAPTER  III 
ILLUSTRATIVE  EXAMPLES 

EXAMPLE  I 

Consider  the  second-order  feedback  control  system  of  Figure  2. 
The  amplifier  gain  k  is  the  only  variable  parameter,  and  is  to  be 
selected  so  that  the  system's  transient  response  to  a  given  disturbance 
is  a  best  approximation  to  the  model,  or  desired  response.   The  model 
response  has  been  chosen  by  the  designer  as  the  response  characterized 


-i 


s(s  +  1; 


Fig.  2  Feedback  control  system  of  Example  I 

by  closed-loop  roots  of  damping  ratio  £  =  0.7  and  natural  frequency 

60  =2.0  radians  per  second.   An  inspection  of  the  system  root  locus 
n 

for  0  <.   k  ^  oo  makes  it  immediately  apparent  that  the  ideal  root  lo- 
cation is  unattainable.   One  may  therefore  turn  to  minimization  of  a 
performance  index,  as  suggested  in  the  previous  pages,  as  a  means  of 
selecting  k. 

The  system  of  Figure  2  is  for  present  purposes  best  represented 
by  the  state  variable  signal-flow  graph  of  Figure  3(a).   The  model 
system  of  Figure  3(b)  reflects  the  desired  but  unattainable  char- 
acteristic equation  coefficients  for  the  specified  root  locations. 
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Fig.  3  Signal-flow  graphs,  Example  I. 
(a)  actual,  (b)  model 
From  characteristic  equation  s^  4.  a_s  +  a.  ■  0 

For  convenience,  let  the  system  be  disturbed  by  the  initial  conditions 
x.(0)  ■  1.0,  x2(0)  =  0,  and  r(t)  =  0.   The  cost  function  of  equation 
(21)  then  reduces  to 


J«  xl(0)  pn=  pn 


(28) 


where  p..  is  given,  for  this  second-order  system,  by  equation  (19) 
The  Q  matrix  is  now  to  be  evaluated.  Substituting  the  model  coef- 
ficients, a.  =  4.0  and  a  =  2.8  into  equations  (24)  and  (25)  gives 

a2  =  -0.01 


and 


(29) 


X  = 


16 


These  values  are  then  substituted  in  equation  (18),  yielding 


Q  = 


( 


i*4) 

16  y 


k 
T6" 


(-0. 


k_ 
16 


«*10 


(30) 


where  a.  =  k  and  a  =  1.0  are  the  actual  system  coefficients.   It 


is 


16 


to  be  noted  that  the  model  coefficients  appear  in  Q  only  through  the 


quantities  a.     and  X*   Wherever  else  in  the  Q  matrix  the  a  's  appear, 

they  are  the  actual  system  coefficients,  either  fixed  and  known,  or 

functions  of  the  parameters  that  are  to  be  determined  as  optimum. 

Equations  (19),  (28),  and  (30)  combine  to  give 

2 


J-  -0.005k*  §2  *  k+  I 


(31) 


Minimizing  J  with  respect  to  k  gives 


!£=  -o.oo5  -  -~  +  rz  =  o 

ok  2k2   16 


(32) 


Equation  (32)  has  the  real  solution 


k  =  2.03 


(33) 


Figure  4  shows  the  system  root  locus  and  compares  the  model  and 

JO) 
actual  root  locations* 


Model  -~L 

Ctf  -  2.0 
n 

C  =  0.7 


-X- 


Xr 


Optimum 

O)  -  1.425 
n 

C  =  0.35 


Fig.  4  Root  locations  for  Example  I 


Figure  5  compares  the  model  and  actual  transient  responses,  as 
simulated  on  the  analog  computer. 
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Actual 


Fig.  5  Transient  responses,  Example  I 

Further  insight  into  the  method  and  means  by  which  the  optimum 
value  of  k  was  found  may  be  obtained  by  investigation  of  the  cost 
function  associated  with  two  free  coefficients  in  Example  I.   If  both 
coefficients  in  the  characteristic  equation  are  allowed  to  be  free, 
the  Q  matrix  becomes,  for  the  same  model  values  of  a  =  4.0  and 


a2  =  2.8, 


0*S) 


a  a 
12 

16 


a  a 

12 

16 


(-°'01  +  lf) 


(34) 


The  cost  function  from  equations  (19),  (28),  and  (34)  is  now 

2 

(35) 


*2        al    1      al 


Figure  6  is  a  plot  of  the  surface  generated  by  equation  (35).  This 
surface  is,  for  the  initial  conditions  of  the  example,  uniquely  asso- 
ciated with  the  values  of  the  model  coefficients,  a.  =  4.0  and 
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a.  =   2.8,  and  displays  its  minimum  J  .    .at  these  very  values. 
2  J  min  min  J 

This  is  a  consequence  of  the  way  in  which  the  Q  matrix  was  constructed, 
and  of  the  manner  in  which  the  weighting  factors  were  derived;  com- 
plete freedom  to  vary  all  coefficients  will  always  yield  the  model  sys- 
tem.  In  the  case  of  Example  I,  where  a  constraint  is  placed  on  one 
of  the  two  coefficients  in  the  form  of  a  =  1.0,  it  is  not  possible  to 
drive  to  the  absolute  minimum  on  the  cost  surface.   The  constraint  is 
equivalent  to  passing  the  plane  a.  =  1.0  through  the  cost  surface. 
The  optimum  value  of  a.  =  k  is  then  that  value  which  achieves  a  min- 
imum J    on  the  intersection  of  the  plane  and  surface.   From  Figure 
min 

6,  it  is  seen  that  this  value  is  k  =  2.03,  in  agreement  with  equation 
(33). 
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9.0  • 


Pig.  6  Isometric  pro- 
jection of  the  cost 
surface  in  Example  I, 
as  a  function  of  the 
two  variables  a  and 

a_,  for  a  model  sys- 
tem characterized  by 

r  »  0.7  and  u)  =  2.0 

**  n 


(ax   =  4.0,  a2 


2.8) 
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EXAMPLE  II 

The  third-order  feedback  control  system  of  Figure  7  is  to  be 
compensated  using  rate  feedback  as  shown.  The  gains  h  and  k  are 


r~-^i 

> 

i 

c 

? 

s    (s  +  l)2 

us 

Fig.  7  Feedback  control  system  of  Example  II 

to  be  selected  so  that  the  system  is  optimum  with  respect  to  a  model 
having  a  complex  conjugate  root  pair  with  oj  =2.0  radians  per  sec- 
ond and  £  =  0.7,  and  the  third  root  at  s  =  -5.0.   Inspection  shows 
that  the  model  poles  have  been  placed  in  a  region  of  the  s  plane  made 
unattainable  by  the  constraints  of  the  compensation  scheme  chosen. 
The  model  root  locations  correspond  to  the  characteristic  equation 


s3  +  7.8s2  +  18s  +  20  *  0 


(36) 


The  actual  system  is  characterized  by  the  equation 


s3  +  2s2  +  (h  +  l)s  +  k  -  0 


(37) 


Equation  (37)  shows  that  a  in  the  actual  system  is  constrained  to 
the  value  2.0,  and  that  there  exists  complete  freedom  to  vary  the 
a  and  a„  coefficients. 
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To  show  the  single  cost  surface  associated  with  three  degrees 
of  coefficient  freedom  is,  of  course,  graphically  impossible.   The 
constraint  a~  =  2.0,  however,  is  effectively  a  plane  which  intersects 
the  hypersurface  in  such  a  way  as  to  yield  a  subsurface  dependent 
upon  a.  and  a  alone,  and  hence  graphically  representable.   Equi- 
valently,  a  family  of  surfaces  giving  J  as  a  function  of  a.  and  a_ 
with  a   the  family  parameter  could  be  drawn.   The  surface  corres- 
ponding to  a  r  7.8  would  display  the  absolute  minimum  of  all  sur- 
faces, while  the  surface  drawn  for  a  =  2.0  would  display  a  minimum 
greater  than  the  absolute  minimum,  and  would  yield  the  optimum  values 
of  a.  and  a  and  hence  of  h  and  k.   Figure  8  is  a  plot  of  the  sub- 
surface for  a.  =  2.0,  the  equation  for  which  is  derived  below. 

From  the  recursion  formula  (26),  for  the  third-order  model 
with  a_  a  7.8,  a.  =  18.0,  and  a  =  20.0, 


a 


■2 

= 

a2  "2ala3    12 
2      '  400 
Sl 

'■3 

= 

a3  "2a2 
2 
al 

24.8 
400 

> 

= 

1 
400 

(38) 
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Fig.    8     Isometric   pro- 
jection of  the  cost  sub- 
surface  in  Example   II, 
1    as   a  function  of  the  two 
!    variables   a.    and  a    ,    for 

1  4. 

!  a  model  system  character- 
ized by  a  ■  20.0, 

a    =  18.0,  and  a_  =  7.8, 

and  where  the  actual  sys- 
tem is  constrained  by 
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From  equation  (18),  the  Q  matrix  is 


Q  = 


<1+  400  > 


ala2 
400 


400 


aia2 

400 


.   12    °2  . 
Q400  +  400  ; 


400 


400 


2a2    .24.8    4  . 
400    *  400  +  400; 


(39) 


Again  for  convenience,  the  system  will  be  disturbed  by  an  initial 
unit  displacement  only,  in  which  case 


j  =  xl(0)Pll  =pn 


(40) 


From  the  appendix,  p- -  for  the  third-order  system  is  given  by 


r*!  a3        1  r    aia3       i 

Pll  "    qll  L2ax  +   2(a2a3  -a^    J  "q12  +  q22  L2(a2a3  -a^    J 


-q 


13 


ala3 


.a2Val      . 


,+  q 


33  l_2(a2a3   -a^   _ 


(41) 
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From  equations  (39),  (40),  and  (41),  with  a.  ■  2.0, 
800  a*  -400  a1a2  +  aja2  +  24a^  + 


J  ■ 


_24.8  a^  +  1600  &l 


(42) 


2fll(2a2  -ap 


By  far  the  most  reasonable  method  of  finding  a  and  a   for 

J  .   in  equation  (42)  is  by  surface  search  techniques  using  a  gen- 
min 

eral-purpose  digital  computer.   In  this  case  the  search  was  con- 
ducted by  incrementing  the  parameters  a   and  a  about  an  initial 
point,  testing  for  the  maximum  decrement  in  J,  establishing  a  new 
initial  point,  and  repeating  the  process  until  the  minimum  was  lo- 
cated.  J    was  found  to  lie  at 
min 


ax  =  6.3 


a2  =  7.9 


(43) 


giving  optimum  gain  settings,  by  equation  (37),  of 


k  =  6.3 


h  =  6.9 


(44) 


Figure  9  compares  the  model  and  actual  root  locations,  while 
Figure  10  compares  the  transient  responses. 
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-B- 


□ 


A  Model:   S  =  -5,  -1.4  ±  jl.43 

D  Optimum:  S  =  -0.91,  -0.54  ±  J2.56 

Fig.  9  Root  locations  for  Example  II 


Model 


^Actual 


Fig.  10  Transient  responses  for  Example  II 
It  is  of  interest  to  note  that  the  dominant  mode  method  dis- 
cussed in  Chapter  I,  if  applied  to  Example  II,  yields  a  peculiar  re- 
sult.  Since  two  coefficients  are  independently  free,  it  is  reason- 
able to  expect  that  a  pair  of  complex  conjugate  roots  may  be  exactly 
placed.   No  control  is  possible  over  the  position  of  the  third,  real 
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root,  p.   If  the  conjugate  pair  is  placed  at  £  =  0.7,  u)  =  2.0, 


n 


(s2  +  2.8s  +  4)(s  +  p)  =  0  (45) 

which  upon  multiplication  becomes 

s3  +  s2(2.8  +  p)  +  s(2.8p  +  4)  +  4p  ■  0         (46) 

Equation  (46)  is  to  be  compared,  with  respect  to  coefficients  of  like 
powers  of  s,  to  the  actual  system  equation 

s3  +  2s2  4-  (h  +  l)s  +  k  -  0  (47) 

Such  a  comparison  shows 

p  m   -0.8 

k  =  -3.2  (48) 

h  s  0.76 
The  resulting  system  is  obviously  unstable. 

EXAMPLE  III 

A  feedback  control  system  with  a  zero  in  its  closed-loop  transfer 
function  does  not  fit  the  classification  established  by  Figure  1.   It 
will  now  be  shown,  however,  that  zeros  may  be  accounted  for  by  intro- 
duction of  forward,  non- looping  paths  from  appropriate  state  vari- 
ables  in  the  signal- flow  graph  of  Figure  1  ,  and  that  the  method  of 
optimization  employed  in  the  previous  examples  may  again  be  used  with- 
out modification. 

The  closed- loop  transfer  function  of  the  system  in  Figure  11  may 
be  written 
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£_  _1    C_ 

r   r  *  x, 


3     2 
s  +   s  (p  +  1)  +  s(p  +  k)  +  kz 


'  (s  +  z)    (49) 


which  displays  a  closed- loop  zero  at  s  =  -z.  The  signal-flow  graph 


r  Vo 

k    (s  +  z) 

1 

c 

k 

(s  +  p) 

s(s  +   1) 

Fig.  11  Feedback  control  system  of  Example  III 
of  equation  (49)  is  shown  in  Figure  12.   One  notes  that  all  the  closed- 


Fig.  12  Signal-flow  graph  of  equation  (49) 
loop  pole  information  is  contained  within  the  dotted  line  enclosing 
the  feedback  portions  of  the  graph,  and  that  this  part  of  the  graph 
is  consistent  with  the  form  of  Figure  1.   From  equation  (49), 
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c  =  (s  +  z)Xl  (50) 

Equation  (50)  describes  the  feed-forward  paths  necessary  to  make  up 
the  output,  c,  and  also  accounts  for  the  closed-loop  zero. 

The  design  objectives  of  this  example  may  be  stated  by  selecting 
model  values fbr  the  three  poles  and  one  zero.   The  values  of  k,  z, 
and  p  are  then  to  be  selected  so  that  the  resulting  system  is  optimum 
with  respect  to  this  model.   It  should  be  noted  that  at  first  inspection, 
three  parameters  are  independently  variable,  and  that  one  could  con- 
ceivable place  the  three  closed- loop  poles  precisely  where  they  were 
wanted  and  let  the  zero  fall  where  it  may.   This,  however,  is  not  in 
keeping  with  the  idea  of  driving  a  constrained  actual  system  as  close 
as  possible  toward  a  model  whose  respective  pole  and  zero  locations 
are  considered  ideal,  and  which  has  the  same  number  of  poles  and  zeros 
as  the  actual  system. 

The  model  poles  are  specified  as  a  pair  with  a)  =  2.0,  £  ■  0.7, 
and  a  real  pole  at  s  =  -5.0.   The  model  zero  will  be  placed  at  s  =  -2.0. 
One  now  observes  that  the  zero  of  the  actual  system  may  be  made  to 
coincide  exactly  with  the  model  zero  simply  by  setting  z  =  2.0.   This 
is  an  arbitrary  choice  but  a  necessary  one,  since  the  present  method 
optimizes  a  response  on  the  basis  of  pole  location  alone.   There  re- 
mains, then,  the  task  of  placing  the  three  system  poles  so  as  to  be 
optimum  with  respect  to  the  model  poles,  using  the  two  free  parameters 
k  and  p.   Because  the  zero  has  been  dealt  with  and  disposed  ofj  only 
that  part  of  Figure  12  lying  within  the  dotted  line  is  yet  to  be 
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determined.   It  is  for  this  configuration  that  the  optimization  meth- 
od of  Chapters  I  and  II  has  been  derived. 

With  z  ss  2.0,  the  closed- loop  transfer  function  becomes 


c k(s  ±   2) 


r  ~  3    2 

s  4-  s  (p  +  1)  +  S(p  +  k)  +  2k 


(51) 


Because  the  model  pole  locations  of  this  example  are  identical  to  those 
of  Example  II,  a?,  a^»  and  \   are  given  by  equations  (38).   Following 
the  same  steps  as  those  taken  between  equations  (39)  and  (42)  of  Ex- 
ample II,  one  finds 


J  = 


400p3  +  1600kp2  +  448k2p  +  400p2  +  1600kp 
L-352k2  +  8k3p  +  230.4k3  ±   800k  ±   8k4 


1600k(p2  +  kp  +  p-k) 


(52) 


Minimization  of  (52)  with  respect  to  k  and  p  was  carried  out  by  surface 
search  techniques  and  yielded  the  values 

k  =  10.8 

(53) 
p  =  8.0 

The  cost  J  could  have  been  expressed  in  terms  of  the  a  coeffi- 

n 

cients  rather  than  k  and  p,  in  which  case 

&l  =  2k 

a2  =  P  4  k  (54) 

a3  =  a2  -  3l/2  +  1 
The  minimization  would  then  have  been  carried  out  with  respect  to  a 
and  a2  rather  than  k  and  p.   Algebraic  solution  for  k  and  p  would  then 
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follow  by  equations  (54). 

Figure  13  compares  model  and  actual  pole  and  zero  locations, 
while  Figure  14  compares  transient  responses. 


D 


-B- 


A  Model  :   s  =  -5,  -1.4±jl.43 
□  Actual:   s=  -6.6,  -l.16tjl.37 
O  Zero  identical  for  model  and 
actual  systems,  by  choice. 

Fig.  13  Pole  and  zero  locations  for  Example  III 


^-Actual 


Model 


Fig.  14  Transient  responses  for  Example  III 
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It  must  be  emphasized  that  the  solution  obtained  above  is  not  un- 
ique, since  a  different  set  of  optimum  parameters  would  have  emerged 
had  another  value  been  selected  in  the  free  choice  of  the  zero  loca- 
tion.  Furthermore,  many  such  solutions  would  very  likely  show  that 
among  those  many  optimum  systems  there  is  one  that  is  "most  optimum" 
in  terms  of  cost,  J.   Indeed,  this  solution  would  be  the  one  first  men- 
tioned in  this  example,  in  which  the  three  poles  assume  their  model 

values,  giving  the  absolute  minimum  cost,  J  .      .   Doubts  might  be 

min  nun 

cast  on  the  acceptability  of  such  an  "optimum  optimum",  however,  if 
the  zero  turned  out  to  be  far  removed  from  the  model  zero,  for  the 
cost  function  J  does  not  penalize  the  output  of  the  system  of  Figure 
12,  and  acknowledges  the  presence  of  the  zero  only  insofar  as  it  affects 
the  closed-loop  poles.   For  this  reason,  it  is  suggested  that  whenever 
free  zeros  are  introduced,  as  for  example  by  cascade  compensation, 
these  zeros  be  placed  at  or  near  the  model  zero  values  for  a  first 
solution.   The  results  of  Example  III  indicate  that  this  approach  can 
yield  very  satisfactory  results. 
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CHAPTER  IV 
DISCUSSION  AND  CONCLUSION 

A.  STABILITY 

The  question  of  stability  must  be  discussed  in  connection  with 
any  method  of  control  system  design.   The  method  of  the  previous  chap- 
ters will  consistently  yield  a  stable  optimized  system  if  a  few 
straightforward  guide-lines  are  followed  in  setting  up  any  particular 
design  problem. 

The  first  requirement  is  that  the  model  system  be  stable.   This 
insures  that  there  will  exist  a  multi-dimensional  cost  surface,  posi- 
tive in  a  region  surrounding  the  model  parameter  values,  and  exhibiting 
a  minimum  at  these  model  values.   The  region  of  stability  for  the  model 
cost  surface  has  bounds  determined  only  by  the  order  of  the  system. 
The  stable  region  for  the  surface  of  Figure  6,  for  example,  is  defined 
by  a.  >  0,  a,  >  0.   For  the  total  surface  of  Example  II,  of  which 
Figure  8  is  a  subsurface,  the  stability  region  would  be  defined  by 
a^a  -  a.  >  0,  a  >  0,  a  >  0,  a  >  0,  a  fact  which  is  made  evident 
both  by  the  Routh  criterion  and  by  equation  (41). 

The  designer  will  normally  choose  a  compensation  scheme  that 
provides  a  good  measure  of  feedback  from  plant  variables,  simply  be- 
cause these  variables  contain  information  about  the  more  basic  but  un- 
available state  variables.   He  may  also  choose  to  approximate  the 
state  variables  by  the  use  of  various  filter  networks.   In  any  event, 
it  is  more  likely  that  the  final  choice  of  compensation  will  at  least 
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allow  absolute  stability.   Any  concern  with  stability  is  now  ended, 
for  the  optimization  process  that  follows  stabilization  cannot  possibly 
render  the  system  unstable.   The  fact  that  the  system  can  be  stable 
indicates  that  the  real  system's  constraints  on  the  coefficients  of 
the  characteristic  equation  are  such  that  the  cost  subsurface  gen- 
erated by  the  constraints  lies  within  the  stable  region  of  the  model 
surface,  and  exhibits  its  minimum  therein.   Figure  8  shows  just  such 
a  subsurface  generated  by  a  constraint  a.  =  2.0  in  Example  II.   It 
should  be  noted  that  there  is  now  a  secondary  stability  region  ack- 
nowledging the  constraint,  and  defined  by  2a  -  a.  >  0,  a  >  0,  a  >  0. 
In  searching  the  subsurface  for  its  minimum  and  hence  the  optimum 
values  for  a,  and  a~,  care  must  be  taken  that  the  search  begin  at  a 
point  known  to  be  within  the  stable  region. 

In  summary,  stability  is  handled  by  any  of  the  conventional  methods 
By  applying  them,  the  designer  insures  that  the  compensated  system  can 
be  stable.   The  stability  region  for  the  constrained  surface  (sub- 
surface) is  determined,  and  the  search  of  the  subsurface  proceeds  from 
a  point  known  to  be  in  the  stable  region. 

B.   COST  SURFACE  SELECTIVITY 

SENSITIVITY  TO  PLANT  PARAMETER  VARIATIONS 

The  term  selectivity  will  be  associated  with  the  slope  of  the 
cost  subsurface  in  the  neighborhood  of  its  minimum,  or  optimum  point. 
High  selectivity  will  indicate  a  relatively  sharp  minimum;  low  selecti- 
vity, a  shallow  minimum.   Low  selectivity  in  a  cost  function  can  be 
somewhat  undesirable  in  certain  contexts.   Let  it  be  assumed,  for 
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example,  that  a  system  is  being  adaptively  optimized  with  respect  to 
a  certain  integral  index  of  performance,  and  that  the  index,  or  cost, 
is  being  evaluated  by  actual  integration  of  the  appropriate  functions 
of  the  system's  state  variables  as  they  respond  to  a  perturbation. 
It  is  further  assumed  that  the  state  variables  called  for  in  the  in- 
dex are  available  and  measurable.   As  soon  as  measurement  enters  the 
problem,  measurement  errors  inevitably  follow.   It  is  easily  seen  that 
small  errors  in  cost  evaluation  can  bring  about  relatively  large  errors 
in  the  optimum  parameter  settings  for  the  case  in  which  the  cost  sub- 
surface near  the  true  minimum  is  inherently  shallow. 

The  design  method  of  this  paper,  however,  does  not  in  any  way 
rely  upon  the  measurement  of  dynamic  variables,  and  is  to  that  extent 
free  of  low  selectivity  shortcomings.   Given  that  a  cost  subsurface 
has  a  true  minimum,  that  minimum  can  be  located  with  as  much  accuracy 
as  computing  machines  will  allow,  be  the  minimum  shallow  or  sharp. 

Measurement  errors  of  another  kind  do  find  their  way  into  the 
present  method  via  the  identification  of  the  plant's  configuration 
and  fixed  parameters.   The  term  sensitivity  shall  be  employed  to 
describe  the  relationship  between  a  small  change  or  error  in  a 
given  fixed  plant  parameter  and  the  corresponding  displacement  of 
the  cost  subsurface  and  its  true  minimum.   A  high  sensitivity  would 
indicate  that  relatively  greater  care  would  need  be  taken  in  de- 
termining the  fixed  constants  of  the  plant  being  controlled. 

Sensitivity  may  be  dealt  with  quantitatively,  as  will  now  be 
shown  using  Example  I  for  illustration.   Let  the  open- loop  plant 
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pole  in  Figure  2  of  Example  I  take  on  all  values  on  the  negative  real 
axis;  i.e.,  if  the  pole  factor  is  designated  as  (s  +  p)> 


0  <  p  <  00 


(55) 


Assume  that  the  optimum  value  of  k  has  been  determined  for  enough 
values  of  p  to  establish  the  hypothetical  curve  of  Figure  15.  The 


1.0 


Fig.  15  Hypothetical  curve  of  optimum 
gain  k  as  a  function  of  plant  pole  p  for 
the  system  of  Figure  2 

sensitivity  of  the  optimized  parameter  k  to  changes  in  the  plant  pole 
p  is  defined  as 


S   =  & 
kp   dp 


(56) 


of  simply  the  slope  of  the  k  versus  p  curve. 

The  cost  function  of  equation  (31)  may  be  rewritten  to  include 
the  plant  pole  literally,  as  follows; 


Optimization  is  carried  out  with  respect  to  k,  giving 


(57) 


ak 


0.005 


2k 


k 
16p 


+  ^r-=   0 


(58) 
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Equation  (58)  may  be  solved  to  give  the  optimum  k  for  any  plant  pole 
p,  for  the  model  system  selected  in  Example  I,  co  =  2.0,  £  =  0.7.   It 
may  also  be  differentiated  with  respect  to  p  to  yield  the  sensitivity 
of  the  optimum  gain  to  changes  in  the  plant  pole  p.   From  equation 
(58), 


and 


-0.08k2  -  8p2  +  k3  =  0  (59) 


-0.16k  ~  "16p  +  3k2  4^=  0  (60) 

dp  dp 


from  which 


dk  m  16p 

dp~  3k2  -0.16k 


(61) 


Substituting  the  values  p  =  1.0  and  k  =  2.03  from  Example  I,  gives 

Thus  there  has  been  added  to  the  coordinates  of  a  single  point  on  the 
curve  of  Figure  15  the  slope  at  which  the  curve  passes  through  that 
point.   Although  no  further  information  about  the  curve  has  been  de- 
duced, this  figure  for  sensitivity  gives  assurance  that  small  changes 
in  the  plant  pole  about  the  value  p  =  1.0  would  not  call  for  drastic 
changes  in  the  optimum  forward  gain  setting,  and  that  no  violent  de- 
parture from  optimum  response  will  be  observed  if  the  gain  setting  is 
left  at  a  single  constant  value. 

It  is  believed  that  the  sensitivity  problem  as  described  above 
presents  a  potentially  fruitful  area  for  further  investigation. 
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C.   POTENTIAL  APPLICATION  IN  ADAPTIVE  SYSTEMS 

The  examples  in  Chapter  III  deal  with  linear,  time- invariant 
plants  and  the  selection  of  compensator  parameters  to  optimize  per- 
formance relative  to  a  model.   The  design  is  carried  out  but  once, 
and  remains  valid  as  long  as  the  plant  remains  unchanged.   Should 
the  plant  constants  change  for  any  reason,  the  design  becomes  invalid 
in  the  strict  sense  of  optimality  with  respect  to  the  model.   The  ex- 
tent to  which  plant  parameter  variations  may  be  troublesome  is  in 
part  a  function  of  the  sensitivity  associated  with  each  parameter. 
The  effect  of  the  variations  can  be  counteracted  by  effectively  re- 
designing the  system  constantly,  or  as  often  as  new  information  about 
the  changing  plant  parameter  is  made  available.   Thus  the  system 
would  be  adapting  to  changing  conditions  by  continuous  optimization. 

Figure  16  shows  a  suggested  functional  block  diagram  of  such  an 
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Fig.  16  An  adaptive  system  using  a  digital  computer 
for  surface  search  and  optimization. 
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adaptive  system.   It  is  assumed  that  a  satisfactory  scheme  of  plant 
parameter  identification  is  available.   Information  from  the  identifier 
is  sent  to  a  special  purpose  digital  computer,  into  which  has  been 
programmed  all  the  information  necessary  for  the  continual  construction^ 
search,  and  minimization  of  the  cost  subsurface  appropriate  to  the 
plant,  the  compensator  configuration,  and  to  the  model  system.   Optimum 
control  parameter  settings  are  then  continually  updated  as  the  identi- 
fier and  digital  computer  monitor  the  operation  of  the  system. 

Some  further  dividends  are  potentially  available  in  the  adaptive 
system  outlined  above.   Many  identification  schemes  require  as  much 
information  as  possible  about  the  system's  state  variables;  i.e.,  the 
system  output  and  its  successive  derivatives.   These  variables  are  not 
often  available,  especially  in  higher-order  systems.   Identification 
then  requires  that  some  knowledge  of  some,  if  not  all,  of  the  state 
variables  be  gained  by  approximation  techniques.   As  long  as  some  of 
the  higher  derivatives  are  being  approximated  for  use  in  identification, 
they  might  just  as  well  simultaneously  be  used  as  feedback  signals,  en- 
abling greater  conformation  of  the  actual  system  dynamics  to  those  of 
the  model.   In  the  very  unlikely  case  that  all  the  state  variables 
could  be  accurately  approximated,  the  design  procedure  of  this  paper 
is  not  needed,  nor  for  that  matter  is  any  other,  since  complete  free- 
dom would  then  exist  for  the  placement  of  all  system  poles. 

D.   THE  OPTIMUM  SYSTEM  AS  A  FUNCTION  OF  INITIAL  CONDITIONS 

The  illustrative  examples  of  Chapter  III  are  all  based  upon  an 
initial  condition  of  displacement  (x.  (0)  ^  0)  only.   This  type  of 
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disturbance  was  chosen  because  of  its  equivalence  to  a  step  input  for 
a  system  with  unity  feedback  in  the  outermost  loop.  This  conforms  to 
the  wide  use  of  the  step  as  a  test  input  in  control  system  design. 

It  should  be  noted  that  the  admission  of  non-zero  values  for  the 
higher-order  initial  states  will,  for  constrained  systems,  give  rise 
to  optimum  free  parameters  that  yary  as  functions  of  the  direction  of 
the  initial  condition  vector  in  the  initial  condition  vector  space. 
This  may  be  illustrated  by  referring  to  the  cost  associated  with  a 
second-order  system,  as  a  function  of  the  initial  conditions  and  the 
elements  of  the  P  matrix.  This  was  given  in  equation  (21)  as 

J  =  «*<8)  pu  *  2xl(0)  x2(0)  p12  +  x^O)  p22 

(63) 

It  is  obvious  from  equation  (63)  that  at  least  the  shape  of  the  total 
cost  surface  is  a  function  of  the  initial  conditions,  and  that  the 
subsurfaces  and  their  associated  local  minima  generated  by  the  actual 
system  constraints  will  move  about  with  changing  initial  conditions. 
It  must  be  observed,  however,  that  the  minimum  of  the  total  cost  sur- 
face is  unalterably  and  securely  tied  to  those  coordinates  specified 
by  the  coefficients  of  the  model  system.   Equations  (22)  and  (23) 
guarantee  that  the  p  ,'s  share  a  common  minimum  independent  of  the 
initial  conditions,  and  similarly  guarantee  that  any  linear  combination 
of  the  p.'s  such  as  equation  (63),  also  displays  that  same  minimum. 
A  completely  free  system,  then,  will  always  optimize  at  the  model 
values.  A  system  so  constrained  that  the  model  poles  are  unattain- 
able but  relatively  close  to  the  attainable  region  will  yield  a 
narrow  range  of  optimum  solutions  as  initial  conditions  are  changed. 
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It  is  not  necessary  to  exhaust  all  points  in  the  initial  condition 
space  to  observe  the  migration  of  the  optimum  poles  as  a  function  of  the 
initial  conditions .   Figure  17  shows  the  initial  condition  space  for  a 
second-order  system.   Point  "1"  is  located  on  a  unit  circle  centered 
at  the  origin.   Point  "2"  shares  a  radial  line  with  "1",  and  lies  at  a 

x2(o; 


Fig.  17   Initial  condition  space,  second-order  system 

radial  distance  d  from  the  origin.   It  can  be  shown  by  simple  sub- 
stitution in  equation  (63)  that  the  costs  associated  with  points 

2 

"1"  and  "2"  differ  only  by  the  constant  (d  ).   This  means  that  only 

the  unit  circle  in  the  x. (0) ,  x  (0)  plane  need  be  investigated. 
Points  on  this  unit  circle  may  be  "mapped"  onto  the  s-plane  by  de- 
termining the  optimum  pole  locations  for  the  constrained  system  cor- 
responding to  all  points  on  that  circle.   The  result  will  be  a  locus 
or  region  of  optimum  root  locations  for  all  possible  initial  condi- 
tions.  The  size  and  extent  of  the  region,  it  is  felt,  will  in  large 
measure  be  dependent  upon  the  proximity  of  the  model  poles  to  phy- 
sically realizable  pole  locations.   Such  a  region  is  shown  in  Figure 
18,   drawn  for  Example  I.   The  end  points  of  the  optimum  locus  are 
not  determined. 
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Fig.  18  Model  poles  and  optimum  pole 
locus  for  the  conditions  of  Example  I 

It  is  felt  that  further  investigation  of  these  optimum  regions  pre- 
sents a  possible  avenue  for  future  research. 
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APPENDIX 

I  Solution  for  the  P  matrix  from  equation  {13) 

1)  Second-order  system 
From  equation  (13), 


■qll   "q12 

-q21   -q22 


Pll   P12 
P21   P22 


"al  "a2 


-a. 


-a, 


Pll   P12 
P21   P22 

~  (Al)- 


where  P  and  Q  are  symmetric  matrices.   Matrix  multiplication  yields 


■qn  =  -2alPl2 


"q12  *  Pll  "a2P12  "alP22 


'q22  =  2P12  "2a2P22 


(A2) 


Equations  (A2)  may  be  graphed  as  shown  in  Figure  Al. 


Fig.  Al   Signal-flow  graph  for  equations  (A2) 

The  elements  of  the  P  matrix  may  be  written  directly  from  the  graph, 
using  Mason's  gain  formula. 
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pll  = 


"q12  +  2^  qll 


+  2a7  qll  +  2a7  q22 


Pio  = 


lll 


12  "  2a, 


(A3) 


l22 


lll 


22  ~  2a. 


2aia2 


2)  Third-order  system 
From  equation  (13), 


,qll  "q12  "q13 


'q21   "q22  "q23 


•q31  -q32  -q33 


Pll   P12  P13 


P21   P22  P23 


P31  p32  P33 


0   10 
0   0   1 


'al  "a2-a3 


0  0  -a. 


1  0  -a. 


0  1  -a. 


pll 

P12 

P13 

P21 

p22 

p23 

p31 

p32 

P33 

(A4) 
The  nine  scalar  equations  resulting  from  matrix  multiplication  in  equ- 
ation (A4)  may  be  reduced  to  six  by  symmetry.   They  are 


,qll  =  "2alP13 


'q12  =  Pll  "a2P13  "alP23 


>q13  =  P12  "a3P13  "alP33 


,q22  =  2p12  "2a2P33 


(A5) 


>q23  =  P22  "a3P23  +  P13  "a2P33 


"q33  =  2p23  -2a3P33 


These  equations  are  graphed  in  Figure  A2< 
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Fig.  A2  Signal-flow  graph  for  equations  (A5) 
Application  of  Mason's  gain  formula  yields 


p13  '   qll/2al 


Aa2    a3  N 
Pll"  qll  \JT  +  2D  J   "q12  + 


qlla3 
*23  "  2axD 


a2_ 

! 

q22a3 
2D 


q22ala3 
2D 


q._a.a,   q,,a 


li3°r3 


33"! 
2D 


q13a3   q33al 
D   +   2D 


P12  =  " 


q13a2a3   q33aia2 
D    +    2D 


qlla2a3 
2axD 


q22al 
2D 


(A6) 


qlla3   q22   q13 


P33  =  2a, D  *   2D 


q33a2 
2D 


a„a_  +  a! 


»2«3  *  a3    1  N 
P22  *  -q23  +  qn  ^  ~2^5 -^  ) 

q13(a2  +  a3}   q22(a2  +  a3> 
_ +  -_. 


q33(a2  +  aia3) 
2D 


D   =  a2a3-ai 
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3)   Fourth-order  system 
Manipulation  of  equation  (13)  for  the  fourth-order  system  yields  ten 
equations,  whose  graph  is  shown  in  Figure  A3.   The  elements  of  the 
P  matrix  may  again  be  written  directly,  using  Mason's  gain  formula. 
Only  p   is  given  here  because  of  space  limitations. 

2 
a*aA  *a9aT  "aiaAx        q13(ala2  "ala3a4) 


„   r   2     3  4  °2°3  "1"4  N 
Pll  =  qll  I  2^  +  2D )   "q12  + 


q22(ala3a4  "ala2)   q24("ala4)   q33(ala4> 


2D         +     D      +   2D 


q44ala2 
2D 


D  .  a2a3a4  -a^  -  a\ 


(A7) 


4)  Fifth-order  system 
From  equation  (13),  using  signal-flow  graphing,  (not  shown) 
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\  : 


f 


Pll  =  ql       2ax 


/•a2       a3V5  "a2a3a5  "a3  +  2ala3a5  "la4a5    N 

Cs  ♦ ^ ; 


2        2 
a-.a.a-   -a.a0a.ac  +ana0   -a^, 


.                         /*  "1"2"5       13T5  T13     T"5  N 
+  (-qu)  +  q13  Q  5 J 


aia3a4a5  -a^a2  -a^  +  a2a5 

v  2d  y 

2  2                             2            2 
f  WTVlN              ^  ala3  'alV5  > 
V,  23 )  +  q24  C.  5 ) 

3  2  2  2 
ax  -a^a                          ala4a5  *ala3  N 

C — 5 — >qisC — 5 — ; 

2  3  2  3 

aia2a5  ^  aia2a3  -a^ 

+Vl  2D >  q55C  23 ) 


D  =  a2a3a4a5  "ala4a5  "a2a5  "a2a3  "al  *  2ala2a5  t  ala3a4 


4-q22 


+q33 


+q35 


(A8) 


II     Derivation  of  the  g's  and  X 

1)     Second-order  system 
d"P,-  * 


From  — -*■  =0;  i,j=l-2  (A9) 

da. 


and  Q  as  given  in  equation  (18),  six  equations  are  obtained,  only 
two  of  which  are  independent  or  non- trivial.   They  are 

X  -1- 

X  -   2 


and 


al 


-4  -  \  +  -**  -  o  (MO) 

2a2       axa2 
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from  which  ? 

a2   -2al 
<X2  =      l   2  (AH) 

al 

2)     Third-order  system 

From 

op 

—J-  ■   0   ;  1  <;  n  £  3  (A12) 

3an 

i,  j  as  in  equations  (A6) 

and  Q  as  given  in  equation  (18),  eighteen  equations  are  obtained,  only 

three  of  which  are  independent  or  non-trivial.  They  are 

x  =  4 

a 
1 


2         2    2      2   „      n 
ala2  a3  "a2a3  +  ala2+a2+  2ala3  "  ° 


al  a3  +  *A  +  2ala2  +  ala3  <*2  "a2  a3  =  ° 


(A13) 


The  last  two  of  equations  (A13)  may  be  solved  for  the  a's  to  give 


<*o  ■ 


a2  -2aia3 


l2       2 
al 
2  (A14) 

a3  "2a2 
«3"  2 

al 

3)  Fourth-prder  system 
Similar  procedures  applied  to  the  fourth-order  system  yield  four  in- 
dependent equations,  whose  solutions  are 
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a  ■  - 
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al 

(A15) 

a3  "2a2a4  +  2al 
«3 5 

al 

a4  -2a3 

a4 2 

al 

4)  Fifth-order  system 

The  fifth-order  system  yields  the  following  solutions; 

1 
al 

a2  "2ala3 

<*2 2 

al 


a0= 


a2  -2a2a4  +  2aia5 


(A16) 
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